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Abstract 


This  paper  presents  techniques  that  actively  exploit  chaotic  be¬ 
havior  to  accomplish  otherwise- impossible  control  tasks.  The 
state  space  is  mapped  by  numerical  integration  at  different  sys¬ 
tem  parameter  values  and  trajectory  segments  from  several  of 
these  maps  are  automatically  combined  into  a  path  between  the 
desired  system  states.  A  fine-grained  search  and  high  computa¬ 
tional  accuracy  are  required  to  locate  appropriate  trajectory  seg¬ 
ments,  piece  them  together  and  cause  the  system  to  follow  this 
composite  path.  The  sensitivity  of  a  diaotic  system’s  state-space 
topology  to  the  parameters  of  its  equations  and  of  its  trajectories 
to  the  initial  conditions  make  this  approach  rewarding  in  spite 
of  its  computational  demands.  Boundaries  of  basins  of  attraction 
can  be  breached,  vastly  altering  both  global  and  local  convergence 
properties.  Strange  attractor  bridges  can  be  found  that  connect 
previously  unreachable  points.  Examples  of  both  are  shown. 
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1  Introduction 


This  paper  presents  control  techniques  that  can  be  applied  to  chaotic  systems. 
The  unique  attributes  of  chaos  are  exploited  by  these  algorithms  in  order  to 
perform  control  tasks  that  could  not  otherwise  be  accomplished.  Programs 
utilizing  extensive  simulation  and  global  recisoning  about  state-space  features 
identify  nonlinear  trajectory  segments  that  can  be  pieced  together  into  a  path 
between  the  specified  states.  The  driving  concept  behind  this  approach  to 
control  of  nonlinear  and  chaotic  systems  is  to  combine  fast  computers  with 
deep  knowledge  of  nonlinear  dynamics  to  improve  performance  in  systems 
whose  performance  is  rich  but  whose  analysis  is  mathematically  and  compu¬ 
tationally  demanding. 

In  a  nonlinear  system,  the  distance  between  neighboring  state-space  tra¬ 
jectories  can  grow  exponentially  with  time,  so  small  trajectory  perturbations 
can  have  serious  global  repercussions.  The  Voyager  missions  used  Jupiter  as 
a  slingshot  for  just  this  reason:  near  the  point  of  closest  approach,  a  small 
change  in  angle,  via  a  short  rocket  burn,  drastically  changed  the  spacecraft’s 
overall  path  in  a  fashion  simply  unobtainable  in  a  linear  system.  Small  errors 
in  that  course  correction  can,  however,  ha\'e  equally  dramatic  effects.  This 
leverage  is  the  power  of  and,  paradoxically,  the  difficulty  with  nonlinearity. 

The  system’s  state  space  is  explored  for  different  parameter  values.  Since 
nonlinear  systems  are  exquisitely  sensitive  to  these  parameters,  a  small  range 
of  parameter  variation  can  give  the  control  algorithm  a  large  range  of  behav¬ 
iors  to  exploit.  Taking  advantage  of  this  range  ..r*d  understanding  these 
behaviors,  the  automatic  path-finding  algorithm  selects  a  set  of  trajectory 
segments  from  the  map?  and  combines  them  to  form  a  path  through  the 
state  space  between  the  desired  system  states.  The  controller  causes  the 
system  to  follow  this  path  by  monitoring  the  system  state  amd  switching  pa¬ 
rameter  values  when  the  segment  junctions  are  reached.  Striking  results  are 
acliieved  with  this  tedmique:  a  very  small  control  action,  delivered  precisely 
at  the  right  time  and  plac^,  can  accurately  direct  the  system  to  a  distant 
point  on  the  state  space.  In  one  of  the  e.xamples  in  this  paper,  a  small  con¬ 
trol  action  briefly  pushes  a  system  in  a  wunterintuitive  direction  in  order 
to  reach  a  path  that  travels  directly  to  the  goal  state.  In  another  example, 
an  equally  small  change  is  used  to  r.H)vc  a  particular  state  from  the  basin  of 
attraction  of  one  fixed  point  to  the  basin  of  another. 

Thrac  techniques  can  be  applied  to  any  system  —  linear  or  nonlinear 
—  but  chaotic  systems  have  several  properties  tliat  make  them  particularly 
useful  from  a  control  .standpoint.  Trajectories  in  such  systems  cover  a  subset 
of  the  state  space  densely,  visiting  arbitrarily  small  neighborhoods  of  every 
{>oint  in  that  subset.  This  denseness  has  obvious  implications  for  reachability: 
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chaotic  attractors  can  be  used  as  bridges  between  otherwise-unconnected 
points.  Furthermore,  such  attractors  contain  an  infinite  number  of  unstable 
periodic  orbits  that  can  be  located  and  stabilized. 

The  rest  of  this  paper  is  orgeinized  as  follows.  Section  2  briefly  reviews 
pertinent  aspects  of  nonlinear  dynamics  theory.  Section  3  outlines  the  con¬ 
trol  algorithms  that  are  used  here  to  find  and  follow  paths  through  state 
space.  Section  4  illustrates  the  algorithm  with  several  numerical  examples 
and  section  5  summarizes  the  work,  its  implications  and  its  connections  to 
previous  research. 


2  Theory 


The  equations  for  an  n-dimensional  nonlinear  system  can  be  written 


—  =  /’(£, (1) 

where  x  is  an  n-vector  whose  elements  are  the  system’s  state  variables  and 
F  is  a  nonlinear  function  of  the  state  x  and  the  parameters  fc,-.  Necessary 
conditions  lor  chaos  are,  in  addition  to  the  nonlinearity  of  F,  that  n  >  3 
and  F(z,  k\, . . . ,  Jbp,!)  be  non-integrable(9].  The  state-space  trajectories  of  a 
dissipative  chaotic  system'  separate  exponentially  over  time  and  yet  remain 
on  a  bounded  fractal  subset  of  the  state  space,  called  a  chaotic  or  strange 
attractor[15),  within  which  are  embedded  an  infinite  number  of  unstable  peri¬ 
odic  orbits.  The  distance  between  nearby  trajectories  grows  as  where 

A  is  the  largest  positive  Lyapunov  exponent[6]  of  the  system.  On  a  sur¬ 
face  of  section  through  the  attractor,  the  unstable  periodic  orbits  appear  as 
fixed  points  at  the  intersections  of  the  stable  and  unstable  manifolds  of  the 
system  ( 1 )  above. 

The  direction  and  magnitude  of  the  vector  fie‘  I  d;\scrib€d  by  the  system 
(1)  depend  strongly  on  the  equations  parametci-.  ..•  .ea.,‘y,  this  sensitivity 
can  be  defined  as 


. K.t)  = 


(2) 


Changes  in  parameter  values  (Al\)  also  affect  the  large-scale  features  of 
the  state-space  plot,  causing  fixed  points  to  split  and  give  birth  to  other 

‘Hanultoniui  or  non-dissipaltve  sy'stems  do  not  have  tractors,  u  their  equations 
preserve  state-space  volumes. 
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fixed  points,  limit  cycles  or  chaotic  attractors.  These  topological  changes 
are  known  as  bifurcations.  Between  bifurcations,  the  Afc,-  can  also  cause 
dramatic  changes  in  the  position,  shape  and  size  of  existing  attractors. 

Both  small-  and  large-scale  changes  can  be  exploited  by  control  algorithms 
if  the  responsible  parameters  are  accessible.  For  example,  Vk,  can  be  used  to 
identify  regions  of  state  and  parameter  space  where  small  AAr,-  have  locally 
large  effects.  Changes  in  attractor  size  or  position  can  make  a  target  state 
reachable  from  different  areas  of  state  space.  Slow,  roundabout  paths  and 
fast,  direct  paths  between  two  points  are  often  separated  only  by  a  small 
parameter  difference. 

If  a  stable  fixed  point  can  be  found  near  the  target  state  for  some  parame¬ 
ter  value,  the  control  problem  is  more  or  less  solved,  provided  that  the  initial 
state  is  in  its  basin  of  attraction.  However,  while  the  stable  fixed  points  of 
a  chaotic  system  do  move  about  the  state  space  as  the  parameters  are  var¬ 
ied,  they  might  only  wander  over  a  small  region  before  bifurcating  into  more 
complex  attractors.  In  general,  it  is  unlikely  that  any  choice  of  parameter 
value  would  place  a  fixed  point  near  the  target  state,  unless  the  path  of  the 
fixed  point  were  fortuitous.  Moreover,  convergence  to  such  points  is  often 
slow. 

If  no  suitable  fixed  points  exist,  stabilization  of  the  system  state  at  a 
particular  point  is,  in  the  classic  sense,  impossible.  An  alternative  control 
objective  is  a  steady-state  orbit  that  returns  to  the  target  point  every  m 
cycles.  The  unstable  periodic  orbits  embedded  within  a  chaotic  attractor 
can  be  located  using  the  method  of  Gunaratne  et  ai(8|.  Points  on  a  section 
that  return  to  their  own  small  neighborhoods  after  m  piercings  are  assumed 
to  be  very  close  to  m-cycles;  averages  of  tight  bunches  of  such  points  are 
taken  to  be  good  approximations  to  unstable  fixed  points. 

These  unstable  periodic  orbits  can  be  stabilized  using  the  control  scheme 
developed  by  Ott  et  ai(i3],  wherein  the  system's  dependence  upon  the  pa¬ 
rameter  is  linearized  about  the  fi.xed  point  on  the  n  —  1 -dimensional  surface 
of  section.  This  works  where  the  linearization  is  a  good  approximation:  in 
the  n  —  1-dimensional  “control  parallelogram”  around  the  point,  whose  size 
is  determined  by  the  control  parameter's  range,  its  effects  on  the  orbit  and 
the  orbit’s  unperturbed  stability  properties.  A  snull  change  in  k  causes  a 
it^=  4*0  periodic  orbit  to  retum,jrftcr  m  cyc4es,  not  to  its  original  coordinates 
Fo.  but  to  some  nearby  point  P.  The  vector  fft  measures  this  efTccl: 


= 


M,, 

dk 


I 

l-ko 


(P  -  Po) 


(3) 
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The  stability  properties  are  determined  by  integrating  the  variations 

c 

dt  ~^dxk 

around  the  orbit.  is  the  component  of  the  system  equations  (1)  and 
the  Sik  are  variations  around  Vq.  The  unstable  eigenvector  e„  and  eigenvalue 
Au  of  this  matrix,  together  with  the  admissible  variation  of  the  parameter  k* 
around  and  the  vector  gk,  determine  Pe^,  the  size  of  the  control  parallelo¬ 
gram,  according  to 

^c*=r|(l-A:^)5r,.e„|  (4) 

Details  about  the  derivation  of  these  formulae  are  given  in  [13]. 

Since  the  control  parallelogram  surrounds  a  point  that  is  embedded  within 
a  chaotic  attractor,  all  trajectories  will  eventually  enter  the  controller’s  do¬ 
main,  be  driven  to  the  orbit,  and,  in  the  absence  of  noise,  remain  there 
indefinitely.  The  denseness  of  these  orbits  makes  this  technique  very  prac¬ 
tical  if  a  chaotic  attractor  overlapping  the  target  state  exists;  nevertheless, 
target  acquisition  is  a  problem.  The  delay  before  any  particular  trajectory 
wanders  into  the  parallelogram  is  unpredictable,  although  it  does  depend 
stochastically  on  the  ratio  of  the  areas  of  the  parallelogram  and  of  the  entire 
attractor. 


3  The  Control  Algorithm 

The  following  algorithm  can  be  used  to  find  a  path  between  two  state-space 
po'nts  A  ?4id  B  to  within  a  tolerance  T.  The  system  is  stabilized  either 
at  the  target  state  or  upon  a  nearby  periodic  orbit.  Some  restrictions  on 
B  do  apply;  these  arc  discussed  at  the  end  of  the  section.  This  algorithm 
^plies  to  linear,  nonlinear  and  chaotic  systems,  but  only  with  the  latter 
can  it  exploit  the  dense  unstable  periodic  orbits  that  are  embedded  within 
chaotic  attractors.  For  expositional  clarity,  this  presentation  assumes  that 
the  system  has  a  single  parameter  it;  more  parameters  would  simply  increase 
the  size  of  the  search  space  and  the  number  of  indices  needed  to  keep  track 
of  it. 

1.  Map  the  state  space  for  different  parameter  values: 

•  Pick  an  initial  range  {Hk)  and  interval  [kit^,  kkigh]  for  k. 

•  Construct  state-space  portraits  at  each  -f  nAk  for  {ki^^ 
nAk)  €  [kiovi  ^ktsh],  using  A  as  one  of  the  initial  conditions. 
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•  Construct  portraits  with  a  smaller  Ak  in  ranges  where  successive 
plots  exhibit  large  differences  (e.g.,  large  Vki,  stable  fixed  points 
near  B,  bifurcations  or  changes  in  eiretis  of  chaotic  zones.) 

2.  Establish  the  goal  st‘i.te: 

•  Examine  the  collection  of  state-space  maps  and  locate  a  stable 
fixed  point  that  lies  within  T  of  B. 

•  Failing  that,  identify  parameter  values  that  create  chaotic  attrac¬ 
tors  overlapping  B.  Choose  a  surface  of  section  S  through  B. 
Locate  an  unstable  periodic  orbit  within  T  of  B.  Determine  the 
size  Peo  of  the  parallelogram  of  control  around  the  point  where 
that  orbit  pierces  S. 

3.  Choose  an  initial  grid  size  c  and  find  the  best  (e.g.,  fastest,  shortest 
euclidean  distance)  path  between  the  grid  squares  containing  A  and 
B,  This  segment  can  be  a  portion  of  any  trajectory  on  any  of  the  state- 
space  maps  constructed  in  step  1.  It  is  designated  S®,  starts  at 
and  ends  at  with  k  —  ko. 

4.  Reduce  e  and  find  the  best  path  between  the  grid  squares  containing  B 

and  Iterate  on  successively  smaller  scales  until  c  <  Pco-  Record 

the  k'i  value  and  the  starting  and  ending  states  and  of  each 
segment. 

5.  Similarly,  find  the  best  path  between  Sq  and  A.  The  final  e  depends  not 
on  Pdo  but  on  the  largest  positive  Lyapunov  exponent  of  the  attractor 
of  which  5®  is  a  segment. 

The  system  state  can  be  caused  to  evolve  along  a  trajectory  consisting 
of  a  scries  of  path  segments  {5^,..., 5*}  via  the  following  set  of  control 
actions.  Because  of  the  recursive,  longest-first  nature  of  the  path-finding 
algorithm,  the  segments  are  not  followed  in  the  order  in  which  they  are 
found,  so  the  list  must  first  be  sorted  into  the  proper  order  {S'®, ...,5*'^}. 
Beginning  at  A,  the  parameter  is  set  to  to  initiate  the  first  segment  and 
the  state  is  monitored  until  £  =  The  parameter  is  then  cliaoged  to  k\, 

rerouting  the  system  onto  5'' .  Clearly,  it  is  vital  that  parameter  switclies  take 
place  much  faster  than  the  system’s  time  scales.  This  procedure  is  repeated 
through  all  segments  in  the  path.  After  the  final  switch,  k  is  set  to  the  value, 
determined  in  step  2,  that  creates  the  desired  fixed  point  or  unstable  periodic 
orbit:  in  the  case  of  the  latter,  the  linearized  control  sclienre  of  [13]  is  then 
activated. 


6 


This  algorithm  finds  globally  good  paths  that  have  locally  bad  segments 
(e.g.,  driving  east  to  an  airport  to  catch  a  westward  flight)  —  the  sort  of  path 
that  purely-local  control  schemes  miss.  Even  paths  between  regions  of  state 
space  that  are  apparently  not  connected  can  be  found;  the  control  parameters 
add  dimensions  to  the  space  that  can  open  conduits  between  those  regions. 
The  examples  presented  in  the  next  section  illustrate  both  of  these  cases. 

I  his  particular  version  of  the  path-finding  algorithm,  simplified  for  pre¬ 
sentation,  does  not  apply  to  nonautonomous  systems,  problems  where  the 
final  state  is  unspecified,  or  problems  that  require  a  specific  path  to  be  fol¬ 
lowed.  However,  adapting  the  algorithm  to  fit  these  cases  requires  only  simple 
modifications.  Time  dependence  simply  adds  a  dimension  to  the  problem. 
Where  the  state  can  acceptably  settle  anywhere  in  a  given  range,  control 
problems  could  be  solved  with  a  broadened  fixed-point  search  in  step  2. 
Matching  a  specified  path  would  require  a  different  criterion  for  path  choice 
in  step  3  —  not  the  fastest  or  most  direct  segment,  but  the  best  match  to  a 
specified  path. 

Several  caveats  accompany  this  method: 

•  B  may  not  fail  near  an  unstable  periodic  orbit  or  a  fixed  point  for 
any  value  of  i,  in  which  case  the  algorithm  will  fail.  The  non-zero 
fiaccal  dimension  of  a  chaotic  attractor  and  the  denseness  with  which 
trajectories  cover  it  make  the  former  le^  likely. 

•  This  method  applies  to  systems  of  any  dimension,  but  the  periodic 
orbit  stabilization  method  of  [13]  requires  that  there  be  at  least  as 
many  accessible  parameters  as  theie  are  unstable  eigenvalues  of  the 
orbit. 

•  If  state  ^tiriables  are  not  directly  accessible,  information  about  th.e  sys- 
tcni  state  must  be  synthesized  from  outputs  and  other  accessible  sig¬ 
nals.  Systems  in  which  this  is  not  possible  cannot  be  controlled  using 
this  approach. 

•  Slight  timing  or  parameter  value  errors  (e.g..  quantization  error)  can 
be  magnified  exponentially,  particularly  if  they  occur  at  the  beginning 
of  a  long  segment  or  in  an  area  of  large  The  property  ducidateri 
in  the  Beta  Shadowing  Lemma^  keeps  these  errors  from  being  tnily 
disaslrotis.  but  they  still  ptao*  a  fundamental  upper  bound  on  realizable 
path  length. 

'wit))  bifh  probability,  the  sample  paths  of  the  problem  wiUi  external  noise 
follow  some  orbit  of  the  (ieterministk  system  closeiy''{7]  and  the  detertninistic  orbit  live) 
on  a  bounded  attractor. 
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Constructing  and  examining  state-space  portraits  is  time-consuming.  This 
motivates  the  attempt  in  step  1  of  the  algorithm  to  restrict  attention  to  the 
useful  ones  —  new  maps  only  being  considered  useful  if  their  portraits  differ 
from  the  existing  ones,  regardless  of  the  Ar-interval  between  plots.  The  region 
of  state-space  considered  is  also  restricted:  it  must  be  somewhat  Icirger  than 
the  bounding  box  of  A  and  B  in  order  to  eiUow  for  locally  counterintuitive 
moves.  The  size  of  this  region  is  determined  heuristically  and  can  be  varied 
if  the  algorithm  fails  to  find  a  path  on  its  first  pass.  There  are  many  obvious 
points  in  this  procedure  where  computation  cem  be  traded  for  accuracy:  a 
smaller  Ai  and  larger  range  location  and  study  of  different 

unstable  periodic  points  to  find  the  one  that  is  closest  to  the  target  state 
or  whose  control  parallelogram  is  largest,  variational  analysis  around  each 
segment  to  check  whether,  for  example,  the  k  =  49.9  path  is  better  than  the 
k  =  50  path,  etc. 

Preliminary  versions  of  these  path-finding  and  control  algorithms  have 
been  implemented  and  tested.  The  programs  are  written  in  the  Lisp  dialect 
Scheme[14]  and  run  on  an  HP  series-300  workstation.  State-space  oortraits 
are  computed  from  a  given  set  of  system  equations  using  a  fourth-order 
Runge-Kutta  adaptive  time-step  integrator.  Trajectories  are  indexed  on  a 
state-space  grid  and  represented  as  lists  of  the  grid  squares  that  they  en¬ 
ter.  The  grid  size  e  is  manipulated  as  part  of  the  search  in  step  3  of  the 
path-finding  algorithm. 

The  next  section  of  this  paper  illustrates  these  techniques  with  several 
numerical  exantples. 


4  An  Example 

The  Lorenz  cquationsfllj  are: 


F{t,a,r,h) 


•  « 

a{y  -  z) 

S' 

rz  -  y  -  zs 

4t 

zy-  b: 

(5) 


These  well-known  equations  approximately  describe  convection  in  a  sheet  of 
fluid  heated  from  below.  The  slate  variable  x  is  proportional  to  rxuivcction 
intensity;  y  and  s  quantify  temperature  variations,  a  and  r  arc  physical 
parameters  of  the  fluid  —  the  Praiidtl  and  Ra*  Icigh  numbers  —  and  6  is  an 
aspect  ratio.  Numerical  integration  of  these  equations  from  an  initial  state 
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-45. -"S  l6r*»45ti^  4 


Figure  1:  Lorenz  Attractor  for  a  =  16,  r  =  45  and  b  =  4 

Xq  =  (xo,  yo»  yields  a  time-parametrized  trajectory  x(/)  in  state  space. 
F  is  dissipative  and  nonlinear.  It  is  also  non-integrable  for  some  parameter 
values;  for  these  values,  its  trajectories  converge  to  a  chaotic  attractor.  A 
particular  case  of  this,  shown  in  figure  1,  occurs  for  a  =  16,  r  =  45  and 
6  =  4.  As  this  figure  is  an  x  -  x  projection  of  a  three-dimensional  object,  the 
apparent  trajectory  crossings  do  not  represent  uniqueness  violations.  The 
parameter  values  and  the  initial  slate  are  shewn  at  the  bottom  of  the  figure. 
The  values  in  the  upper  right  and  lower  le{‘.  comers  are  normalized  axis 
coordinates.  An  x  —  r  section^  of  the  same  attractor  at  y  =  —15  is  shown  in 
figure  2.  More  detaib  about  the  structure  and  propeKi^  of  Lorenz  attractors 
may  be  found  in  [19]. 

Consider  the  task  of  navigating  between  the  two  points  marked  by  crosses 
in  figure  3,  starting  at  the  rightmost  (A)  and  ending  at  the  leftmost  (R.) 
On  the  axes  of  the  figure,  the  coordinates  (x.  y,  r)  of  these  points  arc  (8, 
29,  64)  and  (-24.5,  -20,  68).  r  is  used  as  the  control  parameter  and  a  and  b 
are  fixed.  We  make  no  assertions  about  whether  changing  this  parameter  is 
either  physical  or  practical;  this  is  purely  a  mathematical  example^. 

As  set  out  in  step  1  of  the  algorithm  in  section  3,  the  state  space  is 
mapped  with  an  initial  r-step  of  five  and  an  r-rangc  of  [20,60].  Portraits  are 

^Points  appear  OQ  this  mcUoq  wh«te  the  trajectory  pierces  the  y  -15  plane  with  a 
positive  velocity. 

^Lorens  bimtelf  explored  the  parameter  space  outside  the  range  (r  s;  1)  within  which 
the  equaitoos  arc  considered  to  be  ao  accurate  physical  model. 


9 


Figure  4;  Two  Stable  Fixed  Points 

also  constr  oo  .  a  a  finer  grain  (Ar  =  1)  near,  for  example,  the  bifurcation 
at  r  =  24  ihat  creates  a  chaotic  attractor  and  in  the  range  where  that 
attractor  expands  to  cover  B. 

Proceeding  to  the  first  part  of  step  2,  the  maps  are  examined  for  stable 
fixed  points  of  the  system  (5)  at  or  near  B.  The  Lorenz  attractor  collapses 
to  a  pair  of  stable  fixed  points  at  low  r,  as  demonstrated  by  the  r  =  20 
trajectories  in  figures  4(a)  and  4(b).  Note  that  the  two  starting  points  are  in 
different  basins  of  attraction.  Both  of  the  fixed  points  —  whose  coordinates 
are  (8.72,  8.72,  19.00)  and  (-8.72,  -8,72,  19.00)®  —  move  as  r  is  varied,  but 
neither  approaches  B  for  any  value  of  r. 

Since  no  appropriate  fixed  points  exist,  the  second  part  of  step  2  indicates 
that  the  maps  should  be  examined  for  nearby  chaotic  attractors  and  unstable 
periodic  orbits.  Figure  5  shows  a  trajectory  for  r  =  30,  just  above  the 
bifurcation  that  changes  the  fixed  points  of  figure  4  into  a  chaotic  attractor. 
Neither  A  nor  B  happens  to  lie  upon  this  particular  attractor,  so  it  cannot 
be  used  as  a  bridge  between  them  or  as  a  source  of  nearby  unstable  periodic 
orbits.  As  r  is  raised  further,  however,  the  attractor  expands;  one  of  its 
lobes  overlaps  B  when  r  =  42  (figure  6).  For  r  =  50,  an  unstable  seven- 
cycle  is  found  on  the  y  —  -20  x  —  z  surface  of  section  at  V  =  (-24.673, 
68.207).  This  orbit  is  found  by  computing  3000  piercings  of  the  y  -  -20 
plane,  identifying,  sorting  into  bunches  and  averaging  those  that  return  after 
m  cycles,  and  then  choosing  the  one  closest  to  B.  We  assume,  for  the  purposes 

^he  symmetry  is  not  coincideace;  see  {19]  for  details. 
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figure  5;  Lorenz  Attractor  for  a  -  16,  r  =  30  and  b  =  4 


Figure  6:  Lorenz  Attractor  for  a  =  16,  r  =  42  and  b  =  4 
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Figure  7:  Lorenz  Attractor  for  a  =  16,  r  =  50  and  b  =  4 


of  this  probhm,  that  errors  smaller  than  1%  of  the  total  signal  amplitude 
y/x^~Fy‘^  +  2^  are  admissil  ’e,  so  me#=!ts  the  specifications.  The  eigenvalues 
of  the  variationa'  system  integrated  around  the  seven-cycle  are  Au  =  0.734 
and  A,  =  -502.077,  with  the  associated  eigenvectors  c„  =  0.834x  +  0.552i 
and  f,t  =  0.535i  +  0./28ir.  A  1/29?  change  in  r  causes  the  point  to  return 
not  to  itself  f-24.673,  68.207),  but  to  V‘'‘  =(-23.929,  66.498),  so 


9r  = 


?EL 

Or 


=s«  ~  “  1^0.92 


The  allowed  range  of  variation  of  r,  for  a  1 9?  control  tolerance,  is  ±0  0075. 
Using  these  values  in  equation  (4),  we  obtain  Pc,  =  0.096  to  complete  step 


Using  an  initial  choice  of  ?  =  20,  the  collection  of  portraits  is  examined, 
as  described  in  step  3,  for  paths  between  the  grid  squares  containing  A  and 
B.  The  r  =  50  portrait  of  figure  7(a)  ro:  .tains  one  such  segment,  hereafter 
designated  5^ .  An  edited  version  of  this  portrait,  plotted  on  a  smaller  region 
around  the  two  points  and  showin,j  only  the  useful  part  of  the  trajectory, 
IS  shown  in  figure  7(6).  pierces  the  y  -  -20  plane  at  (-24.51,  -19.99, 
68.05),  which  is  actually  within  the  control  p iralleiogram,  so  no  addiMoual 
path  segments  need  be  found  to  connect  5®  and  B. 

To  find  trajectory  segments  that  connect  point  A  to  ihe  other  end  of  5®, 
step  4  is  iterated  in  the  region  outlined  by  th-"  square  in  figure  7(b).  The 
nature  of  the  projection  makes  the  distances  deceptive;  A  is  actu^ly  quite 
far  above  the  nearest  threads  of  the  r  =  50  attractor.  The  segment  S\  found 
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Figure  8:  Schematized  Segmented  Path 

on  the  r  =  40  map  with  «  =  1,  spans  most  of  the  distance  from  A  to  S^.  One 
more  iteration  is  required  on  a  yet-finer  scale  (c  =  0.0001)  to  find  the  two  very 
short  segments  5^  and  5^,  at  r  =  10  and  r  =  8,  needed  to  connect  5'  to  A 
and  to  5®.  Since  5®  actually  enters  the  control  parallelogram  around  B,  this 
process  of  connecting  to  it  atnounts  to  a  solution  to  the  ‘target  acquisition 
problem"  of  [13]. 

A  scliematized  version  of  the  overall  path  is  shown  in  fig¬ 

ure  8.  It  is  composed  of  the  four  segments  discussed  in  the  previous  two 
paragraphs.  The  two  longer  s^ments  are  segments  of  chaotic  attractors; 
the  two  shorter  ones,  enlarged  so  as  to  be  visible,  are  sections  of  transient 
trajectories  ultimately  destined  for  one  of  the  system’s  fixed  points.  The  for¬ 
mer  are  examples  of  a  “strange  attractor  bridge",  connecting  two  otherwise- 
unconnected  points.  The  values  for  the  r,  and  the  are  shown  next  to 
the  segments  and  the  transition  points  where  they  meet.  The  actual  numer¬ 
ical  integration  of  the  path  from  A  to  B  along  (5^,5*,  5^,5®}  is  shown  in 
figure  9.  On  this  scale,  the  smaller  connecting  segments  are  invisible.  Note 
that  5'  actually  moves  the  system  state  directly  sway  (tom  B.  This  locally 
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Figure  9:  Numerical  Integration  of  Segmented  Path 

counterintuitive  move  is  made  in  order  to  reach  a  globally  good  path. 

The  control  program  causes  the  system  to  follow  this  segmented  path 
by  monitoring  the  system  state  and  switching  the  parameter  accordingly. 
The  transition  that  initiates  5°  is  the  most  critical  of  the  three,  as  nonlin¬ 
ear  expansion  along  its  great  length  can  severely  magnify  any  error;  this  is 
where  the  four  decimal  place  accuracy  becomes  important.  The  path  length 
between  A  and  B  is  130.1  normalized  distance  units,  requiring  0.3567  nor¬ 
malized  time  units  to  traverse.  The  contrast  to  the  case  without  active  target 
acquisition  (see  [13])  is  striking:  if  a  trajectory  is  started  at  A  and  simply 
allowed  to  evolve  with  r  =  50,  it  enters  the  control  parallelogram  around  B 
after  traveling  25223  normalized  distance  units  around  the  attractor  in  104 
normalized  time  units.  See  figure  10. 

If  B  were  near  one  of  the  system’s  low-r  fixed  points,  the  first  part  of 
step  2  would  succeed.  Though  a  single  segment  nught  then  converge  to  the 
desired  state,  use  of  a  segmented  path  can  alter  macroscopic  quantities  like 
convergence  speed  and  reachability.  For  example,  a  trajectory  starting  from 
the  point  (22.4,  30.5,  60)  at  the  value  r  =  25  would  normally  converge  to 
the  left  hand  fixed  point  (-9.80,  -9.80,  24.00)  dong  the  tightly-wound  spiral 
at  the  bottom  left  of  figure  11.  The  right-hand  path  in  the  figure  was  found 
by  a  single  pass  of  the  first  two  steps  of  the  algorithm  with  6  =  5.  This  path 
contains  two  segments:  an  r  =  60  trajectory  that  travels  most  of  the  way 
from  (22.4,  30.5,  60)  to  the  other  fixed  point,  which  lies  at  (10.25,  10.31, 
26.77),  and  a  short  section  of  the  r  =  25  spiral  that  surrounds  the  second 
fixed  point.  Not  only  has  this  manipulation  allowed  the  trajectory  to  jump 
the  basin  boundary  and  converge  to  the  opposite  fixed  point,  but  it  has  also 
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Figure  10:  Without  Target  Acquisition 
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bypassed  much  of  the  slowly-converging  spiral  around  that  point. 


5  Conclusion 

The  state-space  features  of  chaotic  systems  are  it^'^ngly  affected  by  param¬ 
eter  vdues.  Moreover,  the  trajectories  that  make  up  those  features  separate 
exponentially  over  time.  Small  changes  in  parameters  or  state  can  thus  have 
large  and  rapid  effects;  this  leverage  is  a  powerful  tool  for  control  algorithms. 
In  this  paper,  we  have  indicated  how  fast  and  accurate  computation  can  be 
used  to  synthesize  paths  through  a  chaotic  system’s  state  space  that  exploit 
this  leverage  to  accomplish  otherwise-unattainable  control  tasks.  Nonlinear 
dynamics  provides  the  mathematical  tools  used  to  choose  values,  tolerances, 
heuristics  and  limits  for  the  algorithms  that  select  and  piece  together  trajec¬ 
tory  segments  to  create  these  paths.  The  Lorenz  system  is  only  one  of  the 
many  systems  to  which  these  techniques  can  be  applied.  Other  examples, 
with  perhaps  more  practical  benefits,  are  phase-locked  loops[4],  robot  manip¬ 
ulators  and  spacecraft  controllers[18],  and  single  and  double  pendulums[5]. 
This  brief  list  is  far  from  complete. 

The  algorithm  is  not  yet  fully  automated;  for  example,  the  determina¬ 
tion  of  when  an  attractor  “covers”  a  point  was  made  by  eye.  Algorithms 
that  produce  qualitative  descriptions  of  state  space,  like  the  Bifurcation 
Interpreter(l],  KAM[20]  or  PLR{16]  will  be  involved  in  the  ultimate  mecha¬ 
nization  of  this.  Mathematical  models  are  currently  used  to  construct  state- 
space  portraits;  errors  in  these  models  can  cause  spectacularly  bad  control 
decisions.  Experimentally  exploring  and  mapping  the  state  space  of  a  physi¬ 
cal  system  [10]  would  probably  be  much  faster  and  would  also  obviate  mod¬ 
eling  error.  Although  these  techniques  have,  to  date,  only  been  applied  to 
simulated  devices,  the  ultimate  aim  of  this  project  is  to  control  actual  phys¬ 
ical  systems.  Instrumented  versions  of  several  chaotic  systems  —  a  double 
pendulum,  a  driven  single  pendulum,  and  several  phase-locked  loops  —  have 
been  builv.  The  I/O  channel  that  transmits  the  state  information  and  con¬ 
trol  parameter  values  between  controller  and  system  is  under  construction. 
These  tools  will  be  used  to  obtain  experimental  verification  of  the  results 
presented  in  this  paper. 

In  the  most  general  terms,  the  implications  of  this  work  are  that: 

•  A  broader  view  and  understanding  of  chaotic  state-space  features  and 
the  effects  of  parameters  upon  them  is  a  pow^ful  tool,  but  its  applica¬ 
tion  requires  great  computational  effort. 
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•  Understood  and  controlled,  chaotic  behavior  can  be  profitably  used  to 
improve  a  system’s  design  and  performance. 

This  approach  can  be  thought  of  as  a  new  flavor  of  adaptive  control  — 
one  that  takes  a  global  viewpoint  and  eschews  almost  all  linearization®.  It 
extends  the  active  use  of  chaos  in  control,  which  presently  consists  of  (1) 
using  knowledge  of  chaotic  zones’  boundaries  to  site  an  operating  point  in 
the  middle  of  the  widest  part  of  a  system’s  largest  stable  zone  to  maximize 
noise  immunity[17]  and  (2)  the  recent  work  on  unstable  periodic  orbits  [13] 
discussed  at  various  points  in  this  paper.  The  main  difference  between  this 
work  and  [13]  lies  in  the  breadth  of  the  aims:  we  wish,  rather  than  to  stabilize 
a  system  on  a  particular  type  of  orbit,  to  navigate  dynamically  through  all  of 
state  space  with  minimal  restrictions.  This  project  also  extends  the  ongoing 
program  of  research  in  our  group  [3]  with  the  overall  goal  of  investigating  the 
use  of  combined  niunerical  and  symbolic  methods  in  scientific  and  engineering 
computing. 

The  complexity  of  the  tasks  that  are  executed  by  this  control  program 
and  the  accuracy  with  which  it  must  perform  make  computation  speed  a  vital 
issue.  The  program  must  compute,  store,  search  through  and  recognize  fea¬ 
tures  in  a  large  number  of  intricate  state-space  portraits  whose  topologies  are 
extremely  sensitive  to  parameter  variations.  At  the  same  time,  many  com¬ 
putational  approximations  are  out  of  bounds  because  the  small  errors  that 
they  introduce  can  be  amplified  exponentially.  Physical  constraints  require 
that  control  actions  take  place  about  an  order  of  magnitude  faster  than  the 
actions  of  the  system  itself,  which  further  exacerbates  the  demands  on  the 
program’s  speed.  All  of  this  work  is  worth  it:  allowing  a  system  to  operate 
in  its  chaotic  regimes  opens  up  new  possibilities  for  better  designs.  Faster 
computers[2]  or  special-purpose  hardware  might  be  part  of  the  ultimate  so¬ 
lution,  together  with  the  understanding  and  algorithms  gained  in  the  course 
of  this  research,  to  attaining  novel  and  effective  control  of  useful  systems  via 
knowledge  of  nonlinear  theory  and  intensive  computation. 


^Some  authors  in  the  adaptive  control  literature  have  hinted  in  the  direction  of  control¬ 
ling  chaos,  but  they  fall  short  of  active  pursuit  of  the  idea  admitting  only  that  “chaotic 
parameter  estimates  are  not  necessarily  «.  bad  thin^  to  ha\'e’'[12]. 
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